Pandas Profiling Report

Dataset statistics

Number of variables	16
Number of observations	4225441
Missing cells	1094
Missing cells (%)	< 0.1%
Duplicate rows	0
Duplicate rows (%)	0.0%
Total size in memory	515.8 MiB
Average record size in memory	128.0 B

Variable types

DateTime	1
Numeric	13
Categorical	2

Warnings

`EndOfDayQuote PreviousCloseDate` has a high cardinality: 1225 distinct values	High cardinality
`EndOfDayQuote PreviousExchangeOfficialCloseDate` has a high cardinality: 1225 distinct values	High cardinality
`EndOfDayQuote Open` is highly correlated with `EndOfDayQuote High` and 6 other fields	High correlation
`EndOfDayQuote High` is highly correlated with `EndOfDayQuote Open` and 6 other fields	High correlation
`EndOfDayQuote Low` is highly correlated with `EndOfDayQuote Open` and 6 other fields	High correlation
`EndOfDayQuote Close` is highly correlated with `EndOfDayQuote Open` and 6 other fields	High correlation
`EndOfDayQuote ExchangeOfficialClose` is highly correlated with `EndOfDayQuote Open` and 6 other fields	High correlation
`EndOfDayQuote PreviousClose` is highly correlated with `EndOfDayQuote Open` and 6 other fields	High correlation
`EndOfDayQuote PreviousExchangeOfficialClose` is highly correlated with `EndOfDayQuote Open` and 6 other fields	High correlation
`EndOfDayQuote VWAP` is highly correlated with `EndOfDayQuote Open` and 6 other fields	High correlation
`EndOfDayQuote Volume` is highly skewed (γ1 = 33.97910384)	Skewed
`EndOfDayQuote Open` has 75907 (1.8%) zeros	Zeros
`EndOfDayQuote High` has 75907 (1.8%) zeros	Zeros
`EndOfDayQuote Low` has 75907 (1.8%) zeros	Zeros
`EndOfDayQuote Close` has 75907 (1.8%) zeros	Zeros
`EndOfDayQuote Volume` has 75907 (1.8%) zeros	Zeros
`EndOfDayQuote ChangeFromPreviousClose` has 328137 (7.8%) zeros	Zeros
`EndOfDayQuote PercentChangeFromPreviousClose` has 328137 (7.8%) zeros	Zeros
`EndOfDayQuote VWAP` has 75907 (1.8%) zeros	Zeros

Reproduction

Analysis started	2021-04-25 04:37:27.981224
Analysis finished	2021-04-25 04:43:31.288419
Duration	6 minutes and 3.31 seconds
Software version	pandas-profiling v2.11.0
Download configuration	config.yaml

EndOfDayQuote Date
Date

Distinct	1221
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	32.2 MiB

Minimum	2016-01-04 00:00:00
Maximum	2020-12-30 00:00:00

Histogram

Histogram with fixed size bins (bins=50)

Local Code
Real number (ℝ_≥0)

Distinct	3711
Distinct (%)	0.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	5784.714955
Minimum	1301
Maximum	9997
Zeros	0
Zeros (%)	0.0%
Memory size	32.2 MiB

Quantile statistics

Minimum	1301
5-th percentile	2004
Q1	3683
median	6063
Q3	7809
95-th percentile	9644
Maximum	9997
Range	8696
Interquartile range (IQR)	4126

Descriptive statistics

Standard deviation	2388.769111
Coefficient of variation (CV)	0.412944999
Kurtosis	-1.159514415
Mean	5784.714955
Median Absolute Deviation (MAD)	2026
Skewness	-0.009063538488
Sum	2.444297174 × 10¹⁰
Variance	5706217.867
Monotocity	Increasing

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
4094	1221	< 0.1%
9977	1221	< 0.1%
1798	1221	< 0.1%
9986	1221	< 0.1%
9984	1221	< 0.1%
9991	1221	< 0.1%
1795	1221	< 0.1%
9990	1221	< 0.1%
9989	1221	< 0.1%
1793	1221	< 0.1%
Other values (3701)	4213231	99.7%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
1301	1221	< 0.1%
1332	1221	< 0.1%
1333	1221	< 0.1%
1352	1221	< 0.1%
1375	71	< 0.1%

Value	Count	Frequency (%)
9997	1221	< 0.1%
9996	1221	< 0.1%
9995	1221	< 0.1%
9994	1221	< 0.1%
9993	1221	< 0.1%

EndOfDayQuote Open
Real number (ℝ_≥0)

HIGH CORRELATION
ZEROS

Distinct	31586
Distinct (%)	0.7%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	1777.224162
Minimum	0
Maximum	93400
Zeros	75907
Zeros (%)	1.8%
Memory size	32.2 MiB

Quantile statistics

Minimum	0
5-th percentile	193
Q1	653
median	1233
Q3	2200
95-th percentile	4805
Maximum	93400
Range	93400
Interquartile range (IQR)	1547

Descriptive statistics

Standard deviation	2378.407548
Coefficient of variation (CV)	1.338270995
Kurtosis	185.2531319
Mean	1777.224162
Median Absolute Deviation (MAD)	696
Skewness	10.06602813
Sum	7509555842
Variance	5656822.465
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0	75907	1.8%
1000	6024	0.1%
1200	5086	0.1%
1400	4965	0.1%
900	4961	0.1%
1500	4887	0.1%
1300	4792	0.1%
800	4730	0.1%
1700	4636	0.1%
2000	4586	0.1%
Other values (31576)	4104867	97.1%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	75907	1.8%
5	15	< 0.1%
6	123	< 0.1%
7	231	< 0.1%
8	284	< 0.1%

Value	Count	Frequency (%)
93400	1	< 0.1%
91450	1	< 0.1%
91200	1	< 0.1%
87560	1	< 0.1%
87230	1	< 0.1%

EndOfDayQuote High
Real number (ℝ_≥0)

HIGH CORRELATION
ZEROS

Distinct	32438
Distinct (%)	0.8%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	1799.549196
Minimum	0
Maximum	96000
Zeros	75907
Zeros (%)	1.8%
Memory size	32.2 MiB

Quantile statistics

Minimum	0
5-th percentile	197
Q1	662.3
median	1250
Q3	2230
95-th percentile	4865
Maximum	96000
Range	96000
Interquartile range (IQR)	1567.7

Descriptive statistics

Standard deviation	2405.297662
Coefficient of variation (CV)	1.336611229
Kurtosis	184.6144266
Mean	1799.549196
Median Absolute Deviation (MAD)	704
Skewness	10.04155423
Sum	7603888954
Variance	5785456.844
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0	75907	1.8%
1000	3983	0.1%
900	3715	0.1%
1400	3630	0.1%
1200	3606	0.1%
800	3600	0.1%
1700	3541	0.1%
1500	3521	0.1%
1300	3466	0.1%
700	3449	0.1%
Other values (32428)	4117023	97.4%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	75907	1.8%
6	43	< 0.1%
7	154	< 0.1%
8	318	< 0.1%
9	224	< 0.1%

Value	Count	Frequency (%)
96000	1	< 0.1%
93600	1	< 0.1%
93030	1	< 0.1%
92800	1	< 0.1%
91180	1	< 0.1%

EndOfDayQuote Low
Real number (ℝ_≥0)

HIGH CORRELATION
ZEROS

Distinct	32097
Distinct (%)	0.8%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	1753.97268
Minimum	0
Maximum	91040
Zeros	75907
Zeros (%)	1.8%
Memory size	32.2 MiB

Quantile statistics

Minimum	0
5-th percentile	190
Q1	643
median	1215
Q3	2172
95-th percentile	4750
Maximum	91040
Range	91040
Interquartile range (IQR)	1529

Descriptive statistics

Standard deviation	2350.642522
Coefficient of variation (CV)	1.340181947
Kurtosis	185.8644522
Mean	1753.97268
Median Absolute Deviation (MAD)	687
Skewness	10.0897725
Sum	7411308075
Variance	5525520.267
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0	75907	1.8%
1000	4888	0.1%
800	3960	0.1%
700	3896	0.1%
1200	3831	0.1%
900	3807	0.1%
500	3749	0.1%
1400	3688	0.1%
600	3648	0.1%
1500	3484	0.1%
Other values (32087)	4114583	97.4%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	75907	1.8%
4	2	< 0.1%
5	51	< 0.1%
6	162	< 0.1%
7	326	< 0.1%

Value	Count	Frequency (%)
91040	1	< 0.1%
88100	1	< 0.1%
86780	1	< 0.1%
86420	1	< 0.1%
86090	1	< 0.1%

EndOfDayQuote Close
Real number (ℝ_≥0)

HIGH CORRELATION
ZEROS

Distinct	32358
Distinct (%)	0.8%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	1776.606838
Minimum	0
Maximum	93600
Zeros	75907
Zeros (%)	1.8%
Memory size	32.2 MiB

Quantile statistics

Minimum	0
5-th percentile	193
Q1	653
median	1232
Q3	2200
95-th percentile	4806
Maximum	93600
Range	93600
Interquartile range (IQR)	1547

Descriptive statistics

Standard deviation	2378.239576
Coefficient of variation (CV)	1.338641463
Kurtosis	185.3041882
Mean	1776.606838
Median Absolute Deviation (MAD)	695
Skewness	10.06680727
Sum	7506947375
Variance	5656023.483
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0	75907	1.8%
1000	4320	0.1%
900	3552	0.1%
1200	3468	0.1%
800	3467	0.1%
700	3397	0.1%
1400	3393	0.1%
500	3349	0.1%
1500	3346	0.1%
1700	3218	0.1%
Other values (32348)	4118024	97.5%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	75907	1.8%
5	20	< 0.1%
6	117	< 0.1%
7	253	< 0.1%
8	276	< 0.1%

Value	Count	Frequency (%)
93600	1	< 0.1%
92700	1	< 0.1%
92470	1	< 0.1%
90810	1	< 0.1%
87670	1	< 0.1%

EndOfDayQuote ExchangeOfficialClose
Real number (ℝ_≥0)

HIGH CORRELATION

Distinct	32360
Distinct (%)	0.8%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	1817.109075
Minimum	0
Maximum	93600
Zeros	3
Zeros (%)	< 0.1%
Memory size	32.2 MiB

Quantile statistics

Minimum	0
5-th percentile	252
Q1	685
median	1267
Q3	2238
95-th percentile	4845
Maximum	93600
Range	93600
Interquartile range (IQR)	1553

Descriptive statistics

Standard deviation	2412.717533
Coefficient of variation (CV)	1.327778044
Kurtosis	186.389476
Mean	1817.109075
Median Absolute Deviation (MAD)	696
Skewness	10.21908323
Sum	7678087186
Variance	5821205.893
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
1000	4443	0.1%
1400	3641	0.1%
900	3636	0.1%
1200	3631	0.1%
800	3550	0.1%
1500	3505	0.1%
700	3488	0.1%
1700	3440	0.1%
500	3398	0.1%
1300	3300	0.1%
Other values (32350)	4189409	99.1%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	3	< 0.1%
5	20	< 0.1%
6	117	< 0.1%
7	253	< 0.1%
8	277	< 0.1%

Value	Count	Frequency (%)
93600	1	< 0.1%
92700	1	< 0.1%
92470	1	< 0.1%
90810	1	< 0.1%
87670	1	< 0.1%

EndOfDayQuote Volume
Real number (ℝ_≥0)

SKEWED
ZEROS

Distinct	113493
Distinct (%)	2.7%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	428862.0145
Minimum	0
Maximum	364603200
Zeros	75907
Zeros (%)	1.8%
Memory size	32.2 MiB

Quantile statistics

Minimum	0
5-th percentile	500
Q1	7900
median	41700
Q3	202900
95-th percentile	1705800
Maximum	364603200
Range	364603200
Interquartile range (IQR)	195000

Descriptive statistics

Standard deviation	2347483.77
Coefficient of variation (CV)	5.473750742
Kurtosis	2189.189171
Mean	428862.0145
Median Absolute Deviation (MAD)	39900
Skewness	33.97910384
Sum	1.812131139 × 10¹²
Variance	5.510680052 × 10¹²
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0	75907	1.8%
200	33407	0.8%
100	32053	0.8%
400	27969	0.7%
300	25932	0.6%
1000	25429	0.6%
600	25344	0.6%
500	24456	0.6%
800	22444	0.5%
700	20260	0.5%
Other values (113483)	3912240	92.6%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	75907	1.8%
100	32053	0.8%
105	43	< 0.1%
110	1	< 0.1%
115	15	< 0.1%

Value	Count	Frequency (%)
364603200	1	< 0.1%
364566090	1	< 0.1%
305432060	1	< 0.1%
297831300	1	< 0.1%
292476000	1	< 0.1%

EndOfDayQuote CumulativeAdjustmentFactor
Real number (ℝ_≥0)

Distinct	55
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	1.077953106
Minimum	0.05
Maximum	36
Zeros	0
Zeros (%)	0.0%
Memory size	32.2 MiB

Quantile statistics

Minimum	0.05
5-th percentile	0.2
Q1	1
median	1
Q3	1
95-th percentile	2
Maximum	36
Range	35.95
Interquartile range (IQR)	0

Descriptive statistics

Standard deviation	0.774316189
Coefficient of variation (CV)	0.718320848
Kurtosis	224.1103276
Mean	1.077953106
Median Absolute Deviation (MAD)	0
Skewness	10.82342453
Sum	4554827.249
Variance	0.5995655606
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
1	3601326	85.2%
2	193523	4.6%
0.1	169576	4.0%
0.2	101833	2.4%
4	43986	1.0%
3	33990	0.8%
0.5	28329	0.7%
5	10065	0.2%
6	5492	0.1%
8	4279	0.1%
Other values (45)	33042	0.8%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0.05	914	< 0.1%
0.1	169576	4.0%
0.2	101833	2.4%
0.25	851	< 0.1%
0.2832	672	< 0.1%

Value	Count	Frequency (%)
36	28	< 0.1%
25	527	< 0.1%
18	220	< 0.1%
16	1034	< 0.1%
12.0709	651	< 0.1%

EndOfDayQuote PreviousClose
Real number (ℝ_≥0)

HIGH CORRELATION

Distinct	32366
Distinct (%)	0.8%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	1816.486365
Minimum	0
Maximum	93600
Zeros	613
Zeros (%)	< 0.1%
Memory size	32.2 MiB

Quantile statistics

Minimum	0
5-th percentile	252
Q1	685
median	1266
Q3	2238
95-th percentile	4840
Maximum	93600
Range	93600
Interquartile range (IQR)	1553

Descriptive statistics

Standard deviation	2411.214537
Coefficient of variation (CV)	1.3274058
Kurtosis	185.980995
Mean	1816.486365
Median Absolute Deviation (MAD)	696
Skewness	10.20914686
Sum	7675455963
Variance	5813955.544
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
1000	4438	0.1%
1400	3640	0.1%
900	3637	0.1%
1200	3629	0.1%
800	3552	0.1%
1500	3508	0.1%
700	3481	0.1%
1700	3454	0.1%
500	3398	0.1%
1300	3296	0.1%
Other values (32356)	4189408	99.1%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	613	< 0.1%
5	20	< 0.1%
6	116	< 0.1%
7	253	< 0.1%
8	276	< 0.1%

Value	Count	Frequency (%)
93600	1	< 0.1%
92700	1	< 0.1%
90810	1	< 0.1%
87670	1	< 0.1%
87560	1	< 0.1%

EndOfDayQuote PreviousCloseDate
Categorical

HIGH CARDINALITY

Distinct	1225
Distinct (%)	< 0.1%
Missing	613
Missing (%)	< 0.1%
Memory size	32.2 MiB

2020/09/30	7226
2020/09/28	3741
2020/07/27	3736
2020/12/28	3723
2020/10/12	3723
Other values (1220)	4202679

Length

Max length	10
Median length	10
Mean length	10
Min length	10

Characters and Unicode

Total characters	42248280
Distinct characters	11
Distinct categories	2 ?
Distinct scripts	1 ?
Distinct blocks	1 ?

The Unicode Standard assigns character properties to each code point, which can be used to analyse textual variables.

Unique

Unique	1 ?
Unique (%)	< 0.1%

Sample

1st row	2015/12/30
2nd row	2016/01/04
3rd row	2016/01/05
4th row	2016/01/06
5th row	2016/01/07

Value	Count	Frequency (%)
2020/09/30	7226	0.2%
2020/09/28	3741	0.1%
2020/07/27	3736	0.1%
2020/12/28	3723	0.1%
2020/10/12	3723	0.1%
2020/11/16	3712	0.1%
2020/11/30	3711	0.1%
2020/09/25	3710	0.1%
2020/10/05	3710	0.1%
2020/12/21	3706	0.1%
Other values (1215)	4184130	99.0%

Histogram of lengths of the category

Value	Count	Frequency (%)
2020/09/30	7226	0.2%
2020/09/28	3741	0.1%
2020/07/27	3736	0.1%
2020/12/28	3723	0.1%
2020/10/12	3723	0.1%
2020/11/16	3712	0.1%
2020/11/30	3711	0.1%
2020/10/05	3710	0.1%
2020/09/25	3710	0.1%
2020/10/06	3706	0.1%
Other values (1215)	4184130	99.0%

Most occurring characters

Value	Count	Frequency (%)
0	10242892	24.2%
/	8449656	20.0%
2	7606876	18.0%
1	6973094	16.5%
8	1654878	3.9%
7	1631024	3.9%
9	1609152	3.8%
6	1604260	3.8%
3	952005	2.3%
5	772477	1.8%

Most occurring categories

Value	Count	Frequency (%)
Decimal Number	33798624	80.0%
Other Punctuation	8449656	20.0%

Most frequent character per category

Value	Count	Frequency (%)
0	10242892	30.3%
2	7606876	22.5%
1	6973094	20.6%
8	1654878	4.9%
7	1631024	4.8%
9	1609152	4.8%
6	1604260	4.7%
3	952005	2.8%
5	772477	2.3%
4	751966	2.2%

Value	Count	Frequency (%)
/	8449656	100.0%

Most occurring scripts

Value	Count	Frequency (%)
Common	42248280	100.0%

Most frequent character per script

Value	Count	Frequency (%)
0	10242892	24.2%
/	8449656	20.0%
2	7606876	18.0%
1	6973094	16.5%
8	1654878	3.9%
7	1631024	3.9%
9	1609152	3.8%
6	1604260	3.8%
3	952005	2.3%
5	772477	1.8%

Most occurring blocks

Value	Count	Frequency (%)
ASCII	42248280	100.0%

Most frequent character per block

Value	Count	Frequency (%)
0	10242892	24.2%
/	8449656	20.0%
2	7606876	18.0%
1	6973094	16.5%
8	1654878	3.9%
7	1631024	3.9%
9	1609152	3.8%
6	1604260	3.8%
3	952005	2.3%
5	772477	1.8%

EndOfDayQuote PreviousExchangeOfficialClose
Real number (ℝ_≥0)

HIGH CORRELATION

Distinct	32368
Distinct (%)	0.8%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	1816.563751
Minimum	0
Maximum	93600
Zeros	481
Zeros (%)	< 0.1%
Memory size	32.2 MiB

Quantile statistics

Minimum	0
5-th percentile	252
Q1	685
median	1266
Q3	2238
95-th percentile	4840
Maximum	93600
Range	93600
Interquartile range (IQR)	1553

Descriptive statistics

Standard deviation	2411.198993
Coefficient of variation (CV)	1.327340695
Kurtosis	185.9747645
Mean	1816.563751
Median Absolute Deviation (MAD)	696
Skewness	10.20890305
Sum	7675782954
Variance	5813880.584
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
1000	4442	0.1%
1400	3640	0.1%
900	3638	0.1%
1200	3633	0.1%
800	3553	0.1%
1500	3505	0.1%
700	3488	0.1%
1700	3447	0.1%
500	3398	0.1%
1300	3302	0.1%
Other values (32358)	4189395	99.1%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	481	< 0.1%
5	20	< 0.1%
6	116	< 0.1%
7	253	< 0.1%
8	276	< 0.1%

Value	Count	Frequency (%)
93600	1	< 0.1%
92700	1	< 0.1%
90810	1	< 0.1%
87670	1	< 0.1%
87560	1	< 0.1%

EndOfDayQuote PreviousExchangeOfficialCloseDate
Categorical

HIGH CARDINALITY

Distinct	1225
Distinct (%)	< 0.1%
Missing	481
Missing (%)	< 0.1%
Memory size	32.2 MiB

2020/09/30	7233
2020/09/28	3739
2020/07/27	3731
2020/12/28	3722
2020/10/12	3717
Other values (1220)	4202818

Length

Max length	10
Median length	10
Mean length	10
Min length	10

Characters and Unicode

Total characters	42249600
Distinct characters	11
Distinct categories	2 ?
Distinct scripts	1 ?
Distinct blocks	1 ?

The Unicode Standard assigns character properties to each code point, which can be used to analyse textual variables.

Unique

Unique	1 ?
Unique (%)	< 0.1%

Sample

1st row	2015/12/30
2nd row	2016/01/04
3rd row	2016/01/05
4th row	2016/01/06
5th row	2016/01/07

Value	Count	Frequency (%)
2020/09/30	7233	0.2%
2020/09/28	3739	0.1%
2020/07/27	3731	0.1%
2020/12/28	3722	0.1%
2020/10/12	3717	0.1%
2020/10/05	3714	0.1%
2020/11/16	3713	0.1%
2020/09/25	3712	0.1%
2020/12/21	3712	0.1%
2020/11/30	3711	0.1%
Other values (1215)	4184256	99.0%

Histogram of lengths of the category

Value	Count	Frequency (%)
2020/09/30	7233	0.2%
2020/09/28	3739	0.1%
2020/07/27	3731	0.1%
2020/12/28	3722	0.1%
2020/10/12	3717	0.1%
2020/10/05	3714	0.1%
2020/11/16	3713	0.1%
2020/12/21	3712	0.1%
2020/09/25	3712	0.1%
2020/11/30	3711	0.1%
Other values (1215)	4184256	99.0%

Most occurring characters

Value	Count	Frequency (%)
0	10243118	24.2%
/	8449920	20.0%
2	7607055	18.0%
1	6973402	16.5%
8	1654922	3.9%
7	1631036	3.9%
9	1609331	3.8%
6	1604271	3.8%
3	952048	2.3%
5	772421	1.8%

Most occurring categories

Value	Count	Frequency (%)
Decimal Number	33799680	80.0%
Other Punctuation	8449920	20.0%

Most frequent character per category

Value	Count	Frequency (%)
0	10243118	30.3%
2	7607055	22.5%
1	6973402	20.6%
8	1654922	4.9%
7	1631036	4.8%
9	1609331	4.8%
6	1604271	4.7%
3	952048	2.8%
5	772421	2.3%
4	752076	2.2%

Value	Count	Frequency (%)
/	8449920	100.0%

Most occurring scripts

Value	Count	Frequency (%)
Common	42249600	100.0%

Most frequent character per script

Value	Count	Frequency (%)
0	10243118	24.2%
/	8449920	20.0%
2	7607055	18.0%
1	6973402	16.5%
8	1654922	3.9%
7	1631036	3.9%
9	1609331	3.8%
6	1604271	3.8%
3	952048	2.3%
5	772421	1.8%

Most occurring blocks

Value	Count	Frequency (%)
ASCII	42249600	100.0%

Most frequent character per block

Value	Count	Frequency (%)
0	10243118	24.2%
/	8449920	20.0%
2	7607055	18.0%
1	6973402	16.5%
8	1654922	3.9%
7	1631036	3.9%
9	1609331	3.8%
6	1604271	3.8%
3	952048	2.3%
5	772421	1.8%

EndOfDayQuote ChangeFromPreviousClose
Real number (ℝ)

ZEROS

Distinct	4472
Distinct (%)	0.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	0.2733322747
Minimum	-15000
Maximum	15000
Zeros	328137
Zeros (%)	7.8%
Memory size	32.2 MiB

Quantile statistics

Minimum	-15000
5-th percentile	-65
Q1	-11
median	0
Q3	11
95-th percentile	67
Maximum	15000
Range	30000
Interquartile range (IQR)	22

Descriptive statistics

Standard deviation	71.4385091
Coefficient of variation (CV)	261.3614114
Kurtosis	1606.029605
Mean	0.2733322747
Median Absolute Deviation (MAD)	11
Skewness	1.813435813
Sum	1154949.4
Variance	5103.460582
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0	328137	7.8%
1	127777	3.0%
-1	126146	3.0%
2	107349	2.5%
-2	106723	2.5%
5	95085	2.3%
-5	94196	2.2%
-10	92966	2.2%
10	92680	2.2%
3	90474	2.1%
Other values (4462)	2963908	70.1%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
-15000	1	< 0.1%
-9400	1	< 0.1%
-7000	2	< 0.1%
-6640	1	< 0.1%
-5100	1	< 0.1%

Value	Count	Frequency (%)
15000	1	< 0.1%
10000	1	< 0.1%
6600	1	< 0.1%
6300	1	< 0.1%
6000	1	< 0.1%

EndOfDayQuote PercentChangeFromPreviousClose
Real number (ℝ)

ZEROS

Distinct	34810
Distinct (%)	0.8%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	0.04147054047
Minimum	-57.854
Maximum	112.676
Zeros	328137
Zeros (%)	7.8%
Memory size	32.2 MiB

Quantile statistics

Minimum	-57.854
5-th percentile	-3.665
Q1	-1.03
median	0
Q3	0.995
95-th percentile	3.81
Maximum	112.676
Range	170.53
Interquartile range (IQR)	2.025

Descriptive statistics

Standard deviation	2.690620861
Coefficient of variation (CV)	64.88029406
Kurtosis	21.78843732
Mean	0.04147054047
Median Absolute Deviation (MAD)	1.011
Skewness	1.361337039
Sum	175231.322
Variance	7.239440615
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0	328137	7.8%
-0.99	1846	< 0.1%
1	1830	< 0.1%
0.2	1736	< 0.1%
-1	1721	< 0.1%
0.503	1701	< 0.1%
-0.2	1667	< 0.1%
-1.639	1666	< 0.1%
1.01	1645	< 0.1%
-0.826	1625	< 0.1%
Other values (34800)	3881867	91.9%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
-57.854	1	< 0.1%
-45	1	< 0.1%
-35.026	1	< 0.1%
-33.484	1	< 0.1%
-32.258	1	< 0.1%

Value	Count	Frequency (%)
112.676	1	< 0.1%
100	1	< 0.1%
96.93	1	< 0.1%
90	1	< 0.1%
88	1	< 0.1%

EndOfDayQuote VWAP
Real number (ℝ_≥0)

HIGH CORRELATION
ZEROS

Distinct	2342512
Distinct (%)	55.4%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	1776.561016
Minimum	0
Maximum	92285.067
Zeros	75907
Zeros (%)	1.8%
Memory size	32.2 MiB

Quantile statistics

Minimum	0
5-th percentile	193.006
Q1	652.739
median	1232.182
Q3	2200.721
95-th percentile	4807.283
Maximum	92285.067
Range	92285.067
Interquartile range (IQR)	1547.982

Descriptive statistics

Standard deviation	2377.905649
Coefficient of variation (CV)	1.338488028
Kurtosis	185.1881907
Mean	1776.561016
Median Absolute Deviation (MAD)	695.14
Skewness	10.06519141
Sum	7506753754
Variance	5654435.278
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0	75907	1.8%
1400	383	< 0.1%
2000	381	< 0.1%
1800	302	< 0.1%
1700	301	< 0.1%
3000	296	< 0.1%
1600	286	< 0.1%
1000	285	< 0.1%
1500	274	< 0.1%
1900	266	< 0.1%
Other values (2342502)	4146760	98.1%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	75907	1.8%
5.006	1	< 0.1%
5.017	1	< 0.1%
5.022	1	< 0.1%
5.038	1	< 0.1%

Value	Count	Frequency (%)
92285.067	1	< 0.1%
92108.796	1	< 0.1%
89523.627	1	< 0.1%
87709.298	1	< 0.1%
87199.593	1	< 0.1%

Pearson's r

The Pearson's correlation coefficient (r) is a measure of linear correlation between two variables. It's value lies between -1 and +1, -1 indicating total negative linear correlation, 0 indicating no linear correlation and 1 indicating total positive linear correlation. Furthermore, r is invariant under separate changes in location and scale of the two variables, implying that for a linear function the angle to the x-axis does not affect r.

To calculate r for two variables X and Y, one divides the covariance of X and Y by the product of their standard deviations.

Spearman's ρ

The Spearman's rank correlation coefficient (ρ) is a measure of monotonic correlation between two variables, and is therefore better in catching nonlinear monotonic correlations than Pearson's r. It's value lies between -1 and +1, -1 indicating total negative monotonic correlation, 0 indicating no monotonic correlation and 1 indicating total positive monotonic correlation.

To calculate ρ for two variables X and Y, one divides the covariance of the rank variables of X and Y by the product of their standard deviations.

Kendall's τ

Similarly to Spearman's rank correlation coefficient, the Kendall rank correlation coefficient (τ) measures ordinal association between two variables. It's value lies between -1 and +1, -1 indicating total negative correlation, 0 indicating no correlation and 1 indicating total positive correlation.

To calculate τ for two variables X and Y, one determines the number of concordant and discordant pairs of observations. τ is given by the number of concordant pairs minus the discordant pairs divided by the total number of pairs.

Phik (φk)

Phik (φk) is a new and practical correlation coefficient that works consistently between categorical, ordinal and interval variables, captures non-linear dependency and reverts to the Pearson correlation coefficient in case of a bivariate normal input distribution. There is extensive documentation available here.

A simple visualization of nullity by column.

Nullity matrix is a data-dense display which lets you quickly visually pick out patterns in data completion.

The correlation heatmap measures nullity correlation: how strongly the presence or absence of one variable affects the presence of another.

The dendrogram allows you to more fully correlate variable completion, revealing trends deeper than the pairwise ones visible in the correlation heatmap.

First rows

	EndOfDayQuote Date	Local Code	EndOfDayQuote Open	EndOfDayQuote High	EndOfDayQuote Low	EndOfDayQuote Close	EndOfDayQuote ExchangeOfficialClose	EndOfDayQuote Volume	EndOfDayQuote CumulativeAdjustmentFactor	EndOfDayQuote PreviousClose	EndOfDayQuote PreviousCloseDate	EndOfDayQuote PreviousExchangeOfficialClose	EndOfDayQuote PreviousExchangeOfficialCloseDate	EndOfDayQuote ChangeFromPreviousClose	EndOfDayQuote PercentChangeFromPreviousClose	EndOfDayQuote VWAP
0	2016-01-04	1301	2800.0	2820.0	2740.0	2750.0	2750.0	32000.0	0.1	2770.0	2015/12/30	2770.0	2015/12/30	-20.0	-0.722	2778.250
1	2016-01-05	1301	2750.0	2780.0	2750.0	2760.0	2760.0	20100.0	0.1	2750.0	2016/01/04	2750.0	2016/01/04	10.0	0.364	2761.990
2	2016-01-06	1301	2760.0	2770.0	2740.0	2760.0	2760.0	15000.0	0.1	2760.0	2016/01/05	2760.0	2016/01/05	0.0	0.000	2758.867
3	2016-01-07	1301	2740.0	2760.0	2710.0	2710.0	2710.0	31400.0	0.1	2760.0	2016/01/06	2760.0	2016/01/06	-50.0	-1.812	2733.471
4	2016-01-08	1301	2700.0	2740.0	2690.0	2700.0	2700.0	26200.0	0.1	2710.0	2016/01/07	2710.0	2016/01/07	-10.0	-0.369	2709.122
5	2016-01-12	1301	2700.0	2730.0	2640.0	2640.0	2640.0	27500.0	0.1	2700.0	2016/01/08	2700.0	2016/01/08	-60.0	-2.222	2671.927
6	2016-01-13	1301	2680.0	2710.0	2670.0	2690.0	2690.0	20400.0	0.1	2640.0	2016/01/12	2640.0	2016/01/12	50.0	1.894	2693.235
7	2016-01-14	1301	2650.0	2650.0	2620.0	2630.0	2630.0	29700.0	0.1	2690.0	2016/01/13	2690.0	2016/01/13	-60.0	-2.230	2633.502
8	2016-01-15	1301	2650.0	2660.0	2630.0	2650.0	2650.0	11400.0	0.1	2630.0	2016/01/14	2630.0	2016/01/14	20.0	0.760	2647.544
9	2016-01-18	1301	2620.0	2630.0	2610.0	2630.0	2630.0	17300.0	0.1	2650.0	2016/01/15	2650.0	2016/01/15	-20.0	-0.755	2617.110

Last rows

	EndOfDayQuote Date	Local Code	EndOfDayQuote Open	EndOfDayQuote High	EndOfDayQuote Low	EndOfDayQuote Close	EndOfDayQuote ExchangeOfficialClose	EndOfDayQuote Volume	EndOfDayQuote CumulativeAdjustmentFactor	EndOfDayQuote PreviousClose	EndOfDayQuote PreviousCloseDate	EndOfDayQuote PreviousExchangeOfficialClose	EndOfDayQuote PreviousExchangeOfficialCloseDate	EndOfDayQuote ChangeFromPreviousClose	EndOfDayQuote PercentChangeFromPreviousClose	EndOfDayQuote VWAP
4225431	2020-12-17	9997	970.0	1028.0	967.0	1028.0	1028.0	648300.0	1.0	951.0	2020/12/16	951.0	2020/12/16	77.0	8.097	1005.609
4225432	2020-12-18	9997	1024.0	1061.0	1005.0	1044.0	1044.0	603900.0	1.0	1028.0	2020/12/17	1028.0	2020/12/17	16.0	1.556	1040.291
4225433	2020-12-21	9997	1050.0	1061.0	1007.0	1013.0	1013.0	303000.0	1.0	1044.0	2020/12/18	1044.0	2020/12/18	-31.0	-2.969	1026.216
4225434	2020-12-22	9997	1013.0	1017.0	981.0	981.0	981.0	266400.0	1.0	1013.0	2020/12/21	1013.0	2020/12/21	-32.0	-3.159	997.675
4225435	2020-12-23	9997	995.0	1010.0	967.0	980.0	980.0	243400.0	1.0	981.0	2020/12/22	981.0	2020/12/22	-1.0	-0.102	985.447
4225436	2020-12-24	9997	995.0	1037.0	995.0	1025.0	1025.0	332300.0	1.0	980.0	2020/12/23	980.0	2020/12/23	45.0	4.592	1022.925
4225437	2020-12-25	9997	1018.0	1072.0	1018.0	1065.0	1065.0	426200.0	1.0	1025.0	2020/12/24	1025.0	2020/12/24	40.0	3.902	1048.806
4225438	2020-12-28	9997	1080.0	1096.0	1050.0	1072.0	1072.0	391400.0	1.0	1065.0	2020/12/25	1065.0	2020/12/25	7.0	0.657	1073.684
4225439	2020-12-29	9997	1070.0	1095.0	1061.0	1092.0	1092.0	199000.0	1.0	1072.0	2020/12/28	1072.0	2020/12/28	20.0	1.866	1081.915
4225440	2020-12-30	9997	1092.0	1140.0	1076.0	1134.0	1134.0	338900.0	1.0	1092.0	2020/12/29	1092.0	2020/12/29	42.0	3.846	1119.679

Overview

Variables

Most occurring characters

Most occurring categories

Most frequent character per category

Most occurring scripts

Most frequent character per script

Most occurring blocks

Most frequent character per block

Most occurring characters

Most occurring categories

Most frequent character per category

Most occurring scripts

Most frequent character per script

Most occurring blocks

Most frequent character per block

Interactions

Correlations

Pearson's r

Spearman's ρ

Kendall's τ

Phik (φk)

Missing values

Sample

First rows

Last rows